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ABSTRACT 

A mixture  of  failure  rates  can  be  present  in  an  apparently 
homogeneous  population  of  "devices"  due  to  variability  either 
in  their  manufacture  or  in  the  severity  of  their  service  en- 
vironments. An  initial  mixing  distribution  is  the  probability 
distribution  for  different  failure  rates  in  such  a population. 
This  distribution  may  be  updated  to  yield  its  related  residual 
mixing  distribution,  which  is  the  probability  distribution  for 
different  failure  rates  in  the  population  of  survivors  after 
a specified  period  of  service  or  "burn-in."  Residual  mixing 
distributions  resulting  from  arbitrary  mixtures  of  constant 
failure  rates  are  shown  to  be  stochastically  ordered  (decreas- 
ingly)  as  the  period  of  service  or  burn-in  is  increased,  and 
to  approach  in  the  limit  a distribution  degenerate  at  the 
smallest  failure  rate  "present"  in  the  population.  Properties 
of  expected  value  ordering,  stochastic  ordering,  failure  rate 
ordering  and  likelihood  ratio  ordering  are  investigated  to 
show  that,  of  these,  only  likelihood  ratio  ordering  between 
two  initial  mixing  distributions  is  sufficient  to  guarantee 
an  ordering  between  the  expected  values  of  their  respective 
resi luaT  mixing  distributions  over  time. 
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SUMMARY 


I 


It  is  well-known  that  the  failure  rate  function  for 
arbitrary  mixtures  of  exponential  life  distributions  decreases 
over  time,  approaching  as  a limit  the  smallest  failure  rate 
positively  present  in  the  mixture. 

It  is  shown  here  that  the  sequence  of  residual  mixing 
distributions  which  describes  the  distribution  of  failure 
rates  present  in  the  mixture  of  survivors  is  not  only  decreas- 
ing in  expectation  over  time,  but  is  also  a stochastically 
decreasing  sequence,  degenerate  in  the  limit  at  the  smallest 
failure  rate  present  in  the  mixture.  Accordingly,  for  any 
particular  value,  the  proportion  of  items  present  in  the 
population  of  survivors  having  failure  rates  greater  than 
that  value  decreases  over  time.  This  strengthens  the  notion 
that  the  shorter- lived  members  of  the  population  are  being 
"weeded  out." 

Should  it  be  possible  to  alter  the  initial  distribution 
of  failure  rates  present  in  the  mixture,  one  would  seek  an 
alteration  which  would  be  better  than  the  original  mixture, 
not  only  initially,  but  over  time  as  well.  A reasonable  way 
to  measure  "better"  may  be  found  in  the  failure  rate  function 
of  the  mixture.  That  is,  one  might  seek  an  alteration  to  the 
original  mixing  distribution  which  would  lead  to  a reduction 
in  the  mixture  failure  rate  function  over  time. 
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In  seeking  to  find  conditions  on  the  alteration  sufficient 
to  guarantee  the  above-described  improvement,  several  order- 
ings among  the  initial  mixing  distributions  are  considered. 

They  are,  listing  from  weakest  to  strongest,  expected  value 
ordering,  stochastic  ordering,  failure  rate  ordering,  and 
likelihood  ratio  ordering.  The  results  of  this  investigation 
show  that,  of  the  orderings  considered,  only  likelihood  ratio 
ordering  is  sufficient  to  guarantee  the  desired  improvement. 

Likelihood  ratio  ordering  is  shown  to  be  equivalent  in  the 
continuous  case  to  distributions  of  Polya  Type  II.  This  result 
indicates  t-hat  many  of  the  more  commonly  encountered  distribu- 
tions to  this  class,  with  the  gamma  distribution  being 

a CO  iit  and  relevant  example.  Gamma  mixtures  of  expo- 

nentials are  employed  in  reliability  evaluation  for  the 
Trident  Missile  program. 

It  is  shown  that,  in  an  n-point  discrete  mixture,  to 
achieve  the  desired  improvement  by  shifting  mass  from  one 
failure  rate  to  a smaller  one,  the  mass  must  be  removed  from 
the  largest  failure  rate  and  added  to  the  smallest  failure 
rate.  In  the  use  of  this  mixture  to  describe  the  procurement 
of  items  from  n different  sources,  this  result  states  that 
simply  shifting  mass  from  one  source  to  a better  one  will  lead 
to  a mixture  which  will  exhibit  a lower  initial  failure  rate, 
but  a higher  subsequent  one.  One  must  shift  mass  from  the 
poorest  source  to  the  best  source  to  prevent  this  subsequent 
crossover  between  mixture  failure  rates. 
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I.  INTRODUCTION 


A.  BACKGROUND 

Mixtures  of  probability  distributions  have  intuitive 
appeal  in  a number  of  diverse  applications  of  probabilistic 
models.  Their  use  has  spanned  many  years,  dating  back  to 
before  the  turn  of  the  century,  for  example,  Karl  Pearson's 
work  in  1894  [1].  The  breadth  of  their  potential  use  was 
indicated  by  Feller  [2]  in  saying  that  "every  distribution 
may  be  represented  as  a mixture." 

As  indicated  by  Blischke  [3],  two  types  of  problems 
associated  with  mixtures  of  distributions  have  received  much 
attention  in  the  literature.  They  are  the  problems  of  identi- 
fiability  and  parameter  estimation. 

The  problem  of  identif lability  is  one  of  unique  character- 
ization. As  defined  by  Teicher  in  [4],  for  F = {F}  a family 
of  distributions,  a p-mixture  of  F,  say  H,  will  be  called 
identifiable  if  for  any  probability  measure  y*,  the  relationship 

HCx3  = |FCx)dy(F)  = jF(x)dy*(F) 

implies  that  y = y*.  Other  investigations  into  the  identifi- 
ability  of  mixtures  are  given  in  [5],  [6]  and  [7]. 

Given  whatever  assumptions  one  is  willing  to  make  concerning 
the  families  of  distributions  which  may  be  involved  in  the 
mixture,  the  specifying  parameters  of  those  distributions  must 
generally  be  estimated  from  sample  information.  Cohen  and 
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Falls  [8]  provide  a good  example  of  this  sort  of  investigation. 
They  examine  estimation  procedures  in  a number  of  different 
mixtures,  including  mixtures  of  two  Poissons,  two  exponentials, 
and  two  Weibulls.  Their  specific  application  is  in  the  analy- 
sis of  atmospheric  data.  Mixtures  of  binomials  are  examined 
in  [3]  and  [9],  the  latter  with  the  field  of  advertising  as 
an  application.  Parameter  estimation  for  mixtures  of  expo- 
nentials is  treated  in  [10]  and  [11]. 

This  thesis  treats  general  mixtures  of  exponentials.  The 
recognition  of  such  a mixture  as  a Laplace-Stieltj es  transform 
guarantees  its  identif iabil ity  due  to  the  uniqueness  of  deter- 
mining functions  of  such  transforms  as  asserted  in  [12]  and  [2]. 
The  purpose  of  this  effort  is  to  investigate  the  properties  of 
such  a model  with  emphasis  on  the  interpretation  and  applica- 
tion of  results  in  the  reliability  context. 

The  results  in  chapter  II  are  essentially  those  reported 
earlier  by  the  author  in  [13] . 

B.  THE  MODEL 

The  model  we  shall  consider  is  a mixture  of  the  form 

(1.1)  F(t)  = jp  e‘^^  dG(A),  t > 0 

= P(T  > t), 

where  F(t)  is  the  survival  function  of  the  random  variable  T. 
F(t;X)  = e is  the  survival  function  of  the  component  dis- 
tribution given  that  A = A for  A a nonnegative  random  variable 
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having  cumulative  distribution  function  G.  We  can  refer  to 
such  a mixture  as  a G-mixture  of  exponentials. 

We  take  the  usual  definition  for  a failure  rate  function 
as  given  in  [14],  i.e.,  for  the  random  variable  T having 
density  fCt)  and  survival  function  F(t)  , the  failure  rate 
function  h(t]  is  defined  by 

f(t) 

h(t]  = , for  all  t such  that  F(t)  > 0. 

F(t) 

The  initial  mixing  distribution  G may  be  modified  to  yield 
a related  distribution  indexed  according  to  the  value  of  t > 0, 
i.e.,  let  G^(X)  = P (A  £ X|T  > t)  and  define  A(t)  to  Le  a random 
variable  having  cumulative  distribution  function  G^,  which  we 
recognize  to  be  a conditional  distribution  for  A,  given  that 
T > t.  The  relationship  between  a mixing  distribution  G and 
its  corresponding  distribution  G^  is  given  by  a straightforward 
application  of  Bayes'  Theorem  which  yields 

(1.2)  dG.  CX)  = dG(X)  , 

where  the  expectation  is  with  respect  to  G,  the  distribution 
of  A. 

We  shall  find  it  necessary  to  consider  alternative  mixing 
random  variables,  for  example,  Aj^  and  We  associate  with 

each  random  variable  A^  its  distribution  G^^  and  its  corre- 
sponding conditional  distribution  G • as  above. 

1 • L 
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C.  THE  RELIABILITY  PERSPECTIVE 


In  the  reliability  context  for  the  expression  (1.1),  T 
represents  the  time  to  failure  of  an  item  drawn  at  random 
from  a population  of  items  having  different  exponential  life 
distributions,  mixed  according  to  G,  the  distribution  of  A. 

The  exponential  distribution  has  been  widely  employed  in 
modeling  random  lifetimes,  due  largely  to  its  tractability 
and  to  the  fact  that  it  is  the  limiting  life  distribution  of 
complex  equipment  as  the  complexity  and  time  of  operation 
increase.  The  assumption  for  the  latter  result  is  essentially 
that  the  lifetime  of  the  equipment  is  a superposition  of  many 
renewal  processes  [14]  . 

The  failure  rate  of  such  equipment  may  be  considered  to 
be  related  to  both  quality  of  manufacture  and  service  environ- 
ment [15].  Thus,  the  consideration  of  both  variability  of 
manufacture  and  variability  of  service  environment  leads, 
individually  and  jointly,  to  the  choice  of  a mixture  of  com- 
ponent distributions  as  the  description  of  the  life  distri- 
bution of  an  item  drawn  at  random  from  such  a population. 

The  use  of  the  Stieltjes  integral  [12]  admits  continuous, 
discrete,  or  mixed  distributions  G. 

The  conditional  distribution  for  A,  given  that  T > t,  G^, 
is  the  residual  mixing  distribution  at  time  t.  It  represents 
the  revised  distribution  for  the  failure  rate  of  an  item 
randomly  drawn  from  the  mixture,  given  that  the  item  is  still 
functioning  at  time  t.  As  an  item  continues  to  survive  it 
admits  a continual  updating  of  the  information  at  hand 
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concerning  the  mixture  from  which  it  was  drawn.  also 

represents  the  relevant  mixing  distribution  for  an  item 
randomly  drawn  from  the  population  of  survivors  at  time  t. 

For  such  a G-mixture  of  exponentials  it  is  well  known  [16] 
that  the  mixture  failure  rate  h(t)  is  decreasing  in  t (we 
shall  use  'decreasing'  for  non- increasing  and  'increasing'  for 
non-decreasing) , and  that  the  mixture  failure  rate  approaches 
as  a limit,  with  increasing  time  t,  the  least  of  all  parameter 
values  present  in  the  mixture  [17] . 

Aldrich  and  Morton  [18]  and  0-Bar  [19]  showed  that  at  time 
t the  failure  rate  function  of  a G-mixture  of  exponentials  is 
the  expected  value  of  the  residual  mixing  distribution  corre- 
sponding to  that  time,  i.e., 

(1.3)  h(t)  = E[A(t)]. 

Thus,  the  sequence  of  residual  mixing  distributions  is  decreas- 
ing in  expectation.  This  fact  supports  the  intuitive  notion 
that  with  increasing  time  the  shorter-lived  members  of  the 
mixture  are  being  "weeded  out."  O' Bar  [19]  also  showed  that 
the  slope  of  the  mixture  failure  rate  function  over  time  is 
related  to  the  variance  of  the  residual  mixing  distribution 
by 

h' (t)  * -VAR[A(t) ] . 


D.  EXAMPLES 

1 . Two-Point  Discrete  Mixture 

This  represents  the  simplest  discrete  case.  Here, 
G is  defined  for  < X2  by 


13 


( wi 

I Xj,  wi 


ith  probability 


2»  with  probability  P2» 

This  could  be  thought  of  as  a two-vendor  situation,  or  a 
single-vendor  situation  with  two  distinct  service  environments. 
As  developed  in  [19]  , the  mixture  survival  function  is  given 
by 

F(t)  = P(T  > t) 


= P(A  = Aj)P(T  > t|A  = + P(A  = A2)P(T  > t|A  = A2) 

= p^e'^1^  + P2e'^2^. 


The  mixture  failure  rate  function  is 

•Alt 

PiAtC 

hCt) 


•Aot 


(1.4] 


f (t)  _ PiAjS  1 P2A2S  2 

F(t)  p^^e'^l^  + 

Ai  + p^A.e‘*^^2  ■ ^1^^ 


Pi  Ax  P2  A2 


Pi  ^ P2< 


(A?  ” A-.)t 


The  conditional  probability  that  the  item  was  drawn  from 
component  distribution  1,  given  that  it  is  still  functioning 
at  time  t,  p^^  (t)  , is  given  by 

Px  C^)  = P(A  = Aj^  [T  > t) 

P(A  = Aj^,T  > t)  p(T  > tjA  = A^)P(A  = A^] 


P(T  > t) 

Pxe-^1^ 


P(T  > t) 
Pi 


p^e  ^1^  + P2e~^2^ 


Px  + P2e 


■CA2  ■ Ax)t 
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The  conditional  probability  that  the  item  was  drawn 
from  component  distribution  2,  given  survival  to  time  t is 


P2Ct3 


1 - Pi  Ct)  = 


P2  ^ 


P2 

(A_  - X,')t 

Pj^e^  2 1-' 


Pj^  (t)  and  P2Ct)  are  called  the  residual  mixing  probabilities 
and  can  also  be  interpreted  as  the  proportions  of  items  with 
the  component  failure  rates  X2  ^2  population  of 

survivors  at  time  t.  The  residual  mixing  distribution  is 
then  defined  by 

iX^,  with  probability  Pi  (t) 

\2>  with  probability  p^Ct). 

Note  that  p^  (0)  = p^  and  P2CO)  " P2 * As  t increases,  p^ (t) 
increases  from  p^  to  1 and  P2  (r)  decreases  from  ^>2  0* 

2 . Gamma  Mixture 

This  is  a frequently  cited  continuous  model,  due 
primarily  to  its  tractability . For  example,  see  [15]  and 
[20].  Here,  A has  the  density 

gCX)  = X“'^e‘®^,  for  a,  3,  X > 0. 

The  mixture  survival  function  is 
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F(t)  = P(T  > t)  = ( e‘^^g(A)dA 

•^0 

= r 6“  A“-^e-^^dA 

Jq  rt^ 


(6  + t)“  Jo 

Fct)  - [rf-t]”'  ' i »• 

The  mixture  failure  rate  function  is  given  by 


h(t)  = 


(1.5) 


illi 

F(t) 


The  residual  mixing  density  is 


gA\)  = 


e'^^g(A) 


F(t) 


■6  + tl*"  s'"  A“-^e‘^^* 

.~3“J  TW 


■ L 3 J TW 

^ (g^  tj°^  a-1  -(6  + t)A 

r(a)  ^ ® 


which  is  itself  a gamma  density  with  parameters  a and  (S  + t). 
It  represents  the  density  for  the  distribution  of  failure 
rates  in  the  population  of  survivors  at  time  t.  The  relation- 
ship between  G and  in  this  case  is 
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~ 6 + t 


that  is,  A(t)  may  be  obtained  from  A by  a change  of  scale. 
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II.  STOCHASTIC  ORDERING  IN  RESIDUAL  MIXING  DISTRIBUTIONS 


A.  INTRODUCTION 

As  mentioned  in  section  I.C.,  the  fact  that  the  sequence 
of  residual  mixing  distributions  is  decreasing  in  expectation 
leads  to  a conjecture  of  a compatible  stochastic  ordering  of 
such  a sequence.  In  this  section  the  existence  of  such  a | 

stochastic  ordering  is  demonstrated.  It  is  also  shown  that 
the  residual  mixing  distributions  converge  in  distribution  to 
the  distribution  degenerate  at  the  least  parameter  value 
positively  present  in  the  mixture,  with  an  attendant  monotone 
convergence  of  raw  moments.  The  latter  result  is  one  asserted 
by  Aldrich  and  Morton  [18]. 

The  results  are  presented  as  applications  of  Propositions 
2.1  and  2.2,  to  be  developed  in  the  next  section.  These  propo- 
sitions state  properties  of  E{u[A(t)]}  for  fairly  general 
functions  u.  To  indicate  the  relevance  of  these  propositions, 
we  first  note  that  an  expression  of  this  form  is  involved  in 
(1.3),  taking  u[A(t)]  = A(t).  We  next  define  an  indicator 
function 

/ 0,  A < X 

(2.1)  I^(A)  = I 

^1,  A > X 

Using  this  indicator  function,  may  be  expressed  as 

(2.2)  G^(X)  = dG^(x)  = E{I^[A(t)]}, 
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I 


another  expression  of  the  same  form,  with  u[A(t)] 


B.  BASIC  RESULTS 


We  shall  develop  in  Propositions  2.1  and  2.2  of  this 
section  basic  tools  which  should  prove  to  be  useful  in  a wide 
variety  of  applications.  Several  of  these  applications  are 
given  in  section  II. C. 

Using  (1.2)  we  find  that 


^00 

E{u[A(t)]}  = ^ u(X)dG^CX) 


(2.3) 


= 1 


u (X)  e 


-Xt 


0 E(e^^ 


dG(X) 


E[u(A)e'^^] 

E(e‘^^) 


Thus,  expectations  of  functions  of  A(t)  may  be  evaluated  by 
simply  taking  expectations  of  functions  of  A.  A straight- 
forward application  of  the  Monotone  Convergence  Theorem  yields 

^ (E[u(A)e‘^^]}  = E[u(A)  ^ e'^^] 

(2-4)  .At 

= -E[Au(A)e  , 

for  A ^ 0. 

We  next  require  the  function  u to  be  nonnegative  and 
monotone  to  get 

PROPOSITION  2.1.  If  A is  a nonnegative  random  variable  and 
u a nonnegative  monotone  increasing  (decreasing)  function, 
then 


i ! 


i . 

i 

I 


] 

I 

\ 
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I 

t 

4,  (t)  = = E{u[A(t)]}  I 

E(e  I 


is  monotone  decreasing  (increasing)  in  t. 


Proof : Using  (2.4), 


d (J)  _ E(e‘''^^)Er-Au(A)e‘''^^l  - E fu  (A)  e'^^]  E f -Ae’^^]  J 

E(e  ) i 

EfAu(A)e'^^1  ^ E[u(A)e~''^^]  rE(Ae'^^)  ] 

E(e'^^)  E(e'^^)  LE(e'^^)  J [ 


= E{u[A(t)]  }E[A(t)]  - E{A(t)u[A(t)]  } 


= - COV{u[A(t)] , A(t)  }. 


Then,  by  the  property  of  the  covariance  of  similarly/dissimi- 
larly ordered  functions  of  the  same  random  variable, 

(i)  u increasing  in  A(t) 

(ii)  u decreasing  in  A(t) 

We  now  need  two  lemmas  regarding  limits  of  expectations 
involving  time  t as  a parameter. 

I 

LEMMA  2.1.  Given  u a nonnegative  function,  j 


3t  <Pu 


<j)„(t)  < 0,  and 


3t  'Pu 


<j>,.(t)  > 0. 


lim  E[I.  (A)u(A)e*  = 0. 

, tH»« 

Proof : Note  that  * 1 A - A > 0 <=*»  e’ ^4-  in  t 

An  application  of  the  Monotone  Convergence  Theorem  yields 

I 

I 

li  lim  E[I,  (A)u(A)e'*^^‘^^^]  = 0. 
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LEMMA  2.2.  For  X > = inf{X  |(T(X)<1} , 

iim  > 0. 

Proof:  Note  that  “ 1<»A  - X_<0<»e 

for  t > 0.  Then,  E [ Cl- CA)  3 e’ >E[1-I^(A)]  =G(X), 

and  Iim  E[(l-I,  (A))e‘ > G(X)  >0.  D 

t-><»  ' 

If,  in  addition  to  the  monotonicity  requirement  of 
Proposition  2.1,  we  also  require  u to  be  right-continuous 
at  X^,  we  may  find  the  limiting  value  of  as  t -*■<». 

We  state  this  result  in 

PROPOSITION  2.2.  Let  A be  a nonnegative  random  variable 
having  cdf  G,  and  u a nonnegative  monotone  increasing 
(decreasing)  function.  If  u is  right-continuous  at 
X^  = inf{X  |G(X)  < 1} , then  4>y(t)  decreases  (increases) 
monotonically  to  i^(^q)  as  t->“. 

Proof : 

(i)  If  u(A)f  in  A then  4>^(t)  ^ u(X^).  By  Proposition 

2.1,  (|)  (t)4-  in  t.  Thus,  lim  i}>,,(t)  exists  and  lies  in 
^ t-«o  “ 

the  interval  [u(X^) ,“) . Choose  X > X^.  Then, 


^u(t)  = 


E[(l-l^(A))u(A)e'^^]  ^ E[Ip^(A)u(A)e~^^] 
E[(l-Ij^(A))e'^^]  + E[I^(A)e‘^^] 

E[(l-I,  (A))u(A)e'^“’^^^]  + E[I^(A)u(A)e'f^'^^^] 
E[(l-Ij^(A))e'<^^'^^^]  + E[I;^(A)e'^^'^^^] 


Since  u(A)t  in  A, 
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“ E[(l-I,  (A))e‘ + E[I,  CA)e" 


< uCX)  + 


E[I^(A)u(A)e’f^'^)^] 
E[(l-I;^(A))e’^^'^)^]  + E[I;^CA)e’^^'^^^] 


(1) 


Lemmas  2.1  and  2.2  may  be  applied  to  show  that  the  last  term 

in  expression  (1)  goes  to  zero  as  t ^ Therefore, 

lim  <{)  (t)  £ u(X).  Let  X -t-  X to  get  lim  <{)  (t)  _<  u(X  ) . 

^-♦•00  ^ ^ t"**"  ^ ^ 

then,  + ^CX^)  as  t -*■  «>. 

Cii)  The  proof  for  u monotone  decreasing  is  similar  to 
that  above.  Q 


C.  APPLICATIONS 

The  first  application  of  the  tools  developed  in  the 
preceding  section  concerns  the  stochastic  ordering  of  the 
sequence  of  residual  mixing  distributions  and  its  limiting 
distribution,  stated  as 

Theorem  2.1.  If  A is  a nonnegative  random  variable  with  cdf 
G and  = inf  ix  [CTCx)  <1 } , then  for  a G-mixture  of  exponentials 
a)  G^  is  a stochastically  decreasing  sequence  in  t,  i.e., 

t,  < t^  =?.  (X)  > (X),  for  all  X. 

1 - z - ^2 


b)  G^  converges  in  distribution  to  the  distribution 
degenerate  at  X^,  as  t -►  ». 
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Proof : 


a)  By  (2.2), 

= E{l^[A(t)]}. 

Note  that  is  monotone  increasing  in  its  argument. 

Application  of  Proposition  2.1  with  u[A(t)]  = I,[A(t)]  i 

] 

yields  G^(X)+  in  t. 

b)  Application  of  Proposition  2.2  with  u[A(t)]  = I,[A(t)]  I 

^ 1 

yields  as  t | 

I 

( 0,  Xq  ± X I 

^tCM  - I,(X,)  = i 

^ 1,  ^0  > ^.  0 

1 

This  result  strengthens  the  statements  which  can  be  made  | 

I 

about  the  population  of  survivors  at  time  t.  It  was  previ-  'i 
ously  known  that  is  a sequence  decreasing  in  expectation.  5 

Now,  in  addition  we  may  see  that,  given  any  value  X,  the  | 

proportion  of  items  in  the  population  of  survivors  having  a I 

_ I 

failure  rate  exceeding  X (indicated  by  G. (X))  is  decreasing  I 

^ ( 

over  time.  This  relationship  is  clearly  indicated  in  the  | 

examples  of  section  I.D.  by  the  monotonicity  of  the  residual 

I 

mixing  probabilities  in  the  two-point  discrete  mixture,  and  ‘ 

in  the  gamma  mixture,  by  recalling  that  the  relationship  be-  i 

tween  A and  A(t)  is  ] 


Then,  for  we  have 

3+1 

G^^CA)  = P[ACt^)>A]  = P[A  >-^ 


> P[A>-^A]=  P[A(t2)>A]  = CA) 


An  immediate  consequence  of  Proposition  2.2  is  the  well 
known  result  that  a mixture  of  exponentials  is  DFR,  with  its 
failure  rate  approaching  the  least  parameter  value  positively 
present  in  the  mixture.  We  state  this  result  as 

Theorem  2.2.  If  A is  a nonnegative  random  variable  with  cdf 
G and  A^  = inf{X | CCA) <1 } , then  for  a G-mixture  of  exponen- 
tials the  mixture  failure  rate  function,  h(t),  decreases 
monotonically  to  A as  t 

Proof:  As  noted  in  (1.3), 


h(t)  = E[A(t)]  . 


Application  of  Proposition  2.2  with  u[A(t)]  = A(t)  yields 
the  desired  result. 

This  result  may  be  seen  to  hold  in  the  examples  of 
section  I.D.  by  noting  the  expressions  found  for  h(t)  in 
(1.4)  and  (1.5). 

We  may  also  see  the  monotone  convergence  for  the  raw 
moments  of  the  residual  mixing  distribution  in 

Theorem  2.3.  For  p ^ 0,  E[A(t)P]  decreases  monotonically 
to  XP  . 


Proof;  Application  of  Proposition  2.2  with  u[A(t)]  = A(t)P 


yields  the  desired  result.  (] 

The  variance  of  ACt)  is  of  interest,  since  it  has  an 
interpretation  as  the  negative  of  the  slope  of  the  mixture 
failure  rate  function  [O'Bar,  19].  We  state  the  following 
as 

Corollary  1.  The  limit  as  t -►  ® of  VAR[A(t)]  is  zero. 
Proof : We  express  the  variance  of  A^t)  as 

(2.5]  VAR[A(t)]  = E[A(t)^]  - E^[A(t)] 

Then,  by  Theorem  2.3, 

lim  VAR[A(t)]  = = 0.  □ 

Expression  (2.5)  leads  us  to 


Corollary  2.  On  the  interval  (0,  “),  VAR[A(t)]  is  of  bounded 
variation. 

Proof:  From  the  power  series  expansion  for  e^^,  we  have  that 


.n 


n!  At 
— e 

t^ 


> 


for  n a nonnegative  integer.  Thus 


E[A(t)''] 


crAn„-At,  , At  -At, 
= E e ] < nj.  E [e  e ] 


ECe‘^^) 


n 


ECe^^^) 


< 


n ! 

t"E(e’^^) 


for  t > 0. 
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Then,  from  expression  (2.5)  and  Theorem  2.3,  since  VAR[A(t)] 
is  expressed  as  the  difference  of  two  real-valued  nonnegative 
monotone  functions  for  t > 0,  it  is  of  bounded  variation  on 

(0,  “).  n 
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III.  ORDERINGS  OVER  TIME  AMONG  DISTINCT 
G-MIXTURES  OF  EXPONENTIALS 

A.  INTRODUCTION 

Chapter  II  dealt  with  the  behavior  over  time  of  the 
sequence  of  residual  mixing  distributions  {G^}  corresponding 
to  a single  given  mixing  distribution  G. 

The  applications  of  the  model  (1.1)  in  a reliability 
context  prompt  questions  regarding  orderings  among  distinct 
initial  mixing  distributions  G^  or  the  creation  of  some  other 
such  ordering  between  their  corresponding  residual  mixing 
distributions  G-  . over  time.  Specifically,  if  the  initial 

1 , t 

mixing  distribution  can  be  altered,  what  conditions  upon  the 
alteration  can  guarantee  that  the  altered  mixture  would  be  in 
some  sense  better  uniformly  over  time?  This  chapter  contains 
some  results  in  this  direction. 


B.  BASIC  RESULTS 

We  examine  several  orderings,  their  properties  and  their 
interrelationships  in  sections  III.B.l  through  III.B.4. 

1 . Stochastic  Ordering 

We  take  the  usual  definition  for  stochastic  ordering 
as  employed  in  Chapter  II;  that  is,  two  random  variables  are 
stochastically  ordered  if  and  only  if  their  survival  functions 
exhibit  that  ordering. 


Ai  < Gj^(X)  < G2(X)  , for  all  X. 


Another  useful  characterization  of  stochastic  order- 
ing states  that  ^ A2  E [u(A^)  ] £ E[u(A2)],  for  all 
u monotone  increasing.  This  characterization  follows  directly 
from  a lemma  by  Lehmann  [21,  p.  73]  which  states  that 

^2  if  and  only  if  there  exist  two  monotone  increasing 
functions  fj^  and  f2  and  a random  variable  V,  with 
flCv)  1 f2Cv)  for  all  v and  A^  =^"^flCV),  A 2 *'^'^f2(V]. 

That  E[u(Aj^)]  £ E[u(A2)]  is  a necessary  condition  follows 
from  noting  that  E[u(Aj^)I  = E[ufj^(V)]  _<  E[uf2(V)]  = E[u(A2)]. 
That  it  is  sufficient  also  may  be  seen  by  taking 

/I,  if  A > X 
u(A)  = I^(A)  = ! 

^0,  if  A £ X. 

An  equivalent  characterization  is  A^^  £ A2  E [u(A^)  ] 

_>  E[u(A2]]»  for  all  u monotone  decreasing. 

2.  Failure  Rate  Ordering 

We  define  a failure  rate  ordering  between  two  random 
variables  by 

(3.1)  ''i 

where  for  u > v the  indicator  function  ^ is  defined  by 


(3.2) 


I 


u,v 


(x,y) 


1,  ifx>u,  y>v 
0,  otherwise 


and  where  E_ 
P 


indicates  an  expected  value  with  respect  to 
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jr 


the  product  measure  of  and  A2  for  and  A2  inde- 

pendent. We  show  the  equivalence  of  the  definition  above  and 
an  ordering  of  failure  rate  functions  where  they  exist  in 

Lemma  5.1.  Given  two  random  variables,  A^^  and  A2,  with 
failure  rate  functions  h^^  and  h2  respectively,  then 


hj^(X)  ^ h2(X)  for  all  X 

Proof:  (**>•)  Suppose  hj^(X)  > h2(X)  for  all  X.  Then,  for 

u > V, 


\ h^(s)ds  ^ I h2(s)ds 
^v  •^v 

rU  -u 

exp  - 1 h^Cs^ds  £ exp  - 1 h2(s)ds 

■\r 


^l(u)  G2(u) 

G^(v)  - G2(v) 


tT2Cu)?T^Cv)  - > 0 


PCA2  > u)P(Aj^  > v)  - PCA2  > v)P(A^  > u)  £ 0 


C<= ) Reverse  the  above  steps, 
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Likelihood  Ratio  Ordering 


We  define  a likelihood  ratio  ordering  between  two 

//L 

random  variables  by  ^ A2  Ep  [i}>  CA2  ,A  ^ 0 for  all 
functions  (j>  such  that  (|)Cx,y)  = -ij)Cy,x),  and  <()Cx,y)  > 0 
for  X ^ y. 

This  ordering  is  equivalent,  in  the  case  where  the 
random  variables  have  densities,  to  the  assertion  that  Aj^ 
and  A2  belong  to  a family  of  densities  having  monotone 
likelihood  ratio  [21] . Other  characterizations  of  this 
ordering  in  the  continuous  case  are  given  in  [22]  and  [23]. 


These  state  that  A^^ 

and 

^2 

are  said  to  be  totally 

of  order  two,  or  Poly 

a type  II  if  and  only  if 

81(^1) 

«1 

(X2) 

^ 0,  for  < X2* 

82(^1) 

82 

(X2) 

Equivalently,  that 

(3.3) 

81 

82  7-^ 

871177 

gJuTT  ’ ^ ^1  ^2- 

We  show  the  equivalence  of  the  definition  given  for 
likelihood  ratio  ordering  and  equation  (3.3)  in  the  continuous 
case  in 


Lemma 


3.2.  Given  two  random  variables,  Aj^  and  A2,  with 


densities  gj^  and  g2  respectively,  then 
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8i  ^^2^ 

STTcfr  i iTTlfr  . ' ^2  - Ep[*CA2.Ai)J  > 0, 


’I'-  I"'  *2'-  1" 


for  all  functions  <t>  such  that  (Kx,y)  = -ij)(y,x)  and  <p(x,y)  ^ 0, 
for  X ^ y.  ^ ^ 

Proof:  C =*)  Ep[4>CA2.Ai)]  = 1 1 <J>Cx,y)g2(x)gj^  (y)dxdy 

Jo  Jo 


r 

= 1 I <(>Cx,y)g2(x)gj^(y)dxdy 

Jo  Jo 

+ 1 I <l>(x,y)g2(x)g^(y)dxdy 

r 

= I I <fr(x,y)g2(x)g^ (y)dydx 

Jo  Jx 
00  00 

+ J J <l>(x,y)g2(x)g^(y)dxdy 

We  make  changes  of  variables  of  x = v,  y = u in  the  first 
integral  and  y = v,  x = u in  the  second  integral  to  get 

Ep  [<J'(A2,Aj^)  ] = I I (j)(v,u)g2(v)gj^(u)dudv 

Jo  Jy 

0OO 

4i  (u,v)g2  (u)gj^  (v)dudv 

V 

“ I |^4»(u,v)g2(v)gj^(u)dudv 
I 1 4>(u,v)g2(u)g^(v)dudv 

JoJy 

31 


,oo 


Ep[<|)(A2,Ai)  ] = I j 4>(u,v)  [g2(u)g^(v)  - g2  (v)  g^  (u)  ] dudv 

Jq  Jv 


Since  u ^ v over  the  range  of  integration,  the  integrand  is 
nonnegative  by  hypothesis  and  property  two  of  the  function  <J> 

(•*=  ) Let  0 ^ Choose  Az  such  that  0 < Az  < (Z2  - z 

Let  = iz^,  z^  + Az]  for  i = 1,2.  Define 

+1,  for  X t I2,  y e 
<P(x,y)  = -1,  for  X e y e I2 

0,  otherwise 

The  function  4>(A-,A.)  is  shown  in  Figure  3.1. 


Fieure  o.l 


Then,  (A2»Aj^}  J = PCA2el2)P(Aj^eIj^)  - P(A2eIj^)P(Aj^el2)  > 0 

which  yields 

P(A2el2)PCAieIi)  P (A2E P (A^e  I2) 


^ Az)  - 02(22)  Az)  * Gj^(z2) 

Az  Az 

GzCZi  + Az)  - GzCZj^)  Gj^CZz  + Az)  - G^^CZz) 

Az  Az  ~ 


Let  Az  0 to  get  g2  (Z2) <^2 j^)  - g2  (z^) g (Zz)  > 0,  which 
completes  the  proof.  Q 

4 . Relationships  Among  Orderings 

Likelihood  ratio  ordering  is  the  strongest  of  the 
three  orderings.  Its  implication  of  failure  rate  ordering 
may  be  seen  in 

Lemma  3.3.  ^2  "^^1  ^2' 

Proof : Follows  directly  by  defining 

for  the  indicator  function  defined  by  (3.2),  and  noting  that 
(J)(x,y)  = -<{)(y,x)  and  <|)(x,y)  > 0 for  x > y.  Q 

That  the  reverse  implication  does  not  hold  may  be 


easily  seen  by  letting  n = 3,  j = 2 and  k = 3 in  the  counter 
example  of  section  III. C. 2. a. 


We  get  a direct  verification  of  the  well-known  result 
that  failure  rate  ordering  implies  stochastic  ordering  in 

Lemma  3.4.  £*^^^2  ^^1 

Proof : Follows  directly  by  taking  v = 0 in  (3.1)  D 

Letting  u(A)  = A in  the  characterization  for 
stochastically  ordered  random  variables  of  section  III.B.l. 
with  respect  to  monotone  increasing  u yields  the  familiar 
result  that 

^1  i 

C.  APPLICATIONS  TO  MIXTURES  OF  EXPONENTIALS 
1.  Ordering  Inheritance  Hypotheses 

We  first  formulate  hypotheses  asserting  inheritance 
properties  between  orderings  among  initial  mixing  distributions 
and  their  respective  residual  mixing  distributions.  They  may 
be  stated  as 

HI:  E(A^)  < E(A2)  =>  E[A^(t)]  < E[A2(t)]  , t > 0. 

H2:  A^  <^^^2^^^’  t > 0. 

H3:  A^  < ^2  =>  A^(t)  < A2(t)  , t > 0. 

H4:  A^  1^^A2  t > 0. 

We  introduce  the  following  set  identifications: 

A » {(A^,A2)  I E(A^)  < ECA2)} 

B » {(A^,A2)  I E[A^(t)]  < E[A2(t)],  t > 0} 
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C = {(A^,A2)  I A^  <^"^A2} 

D = {CAj^,A2)  I Aj^(t)  l^'^A2Ct),  t ^ 0} 

^ “ {(A]^»A2)  I Aj^  5.*^^  A 2} 

F = (CAj^,A2)  1 < ^'^A2(t),  t > 0} 

G ~ {(Aj^»A2)  I Aj^  5. A 2 } 

H = {(Aj^,A2)  I Aj^(t)  <^^A2(t),  t > 0} 

We  can  now  restate  the  hypotheses  as 
HI:  A C B 

H2;  CCD 
H3:  E C F 

H4:  G C H 

We  know,  by  letting  t 0,  that  B C A,  D C C and  F C E.  Thus, 
hypotheses  H1-H3  are  actually  postulating  equivalences.  We 
also  know  from  the  relationships  given  in  section  III.B.4. 
that  GCECCCAandHCFCDCB. 

2.  Counter-examples  to  Hypotheses 
a.  Hypotheses  HI  and  H2 

We  first  state  an  additional  hypothesis; 


HS:  A^  < -^-^A2  =>  E[A^(t)]  < E[A2(t)]  , t > 0.  (C  C B) 

From  section  III.B.4.  we  know  that  C£  A and  that  D C B.  If 
H5  is  false,  then  C 0 is  not  empty.  That  would  imply  that 
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neither  A n ^ nor  C 0 2J  is  empty.  Thus,  hypotheses  HI  and 
H2  would  be  disproved. 


H5  is  shown  to  be  false  as  follows:  Let  A.  = A. 

2 1 


with  probability  p^,  i = l,...,n,  where  A^^  < A^  Then, 


let 

with 

probability 

Pj  " 

with 

probability 

Pk  - 

^i 

with 

probability 

Pi’ 

4-Ca 

2*  Let  I = {i  1 i 

e {1 

i ^ j,k}.  Then  we  can  write,  summing  from  1 to  n unless 


otherwise  noted. 


E[A2(t)J  = h2(t.) 


Ep. A.e’^i^ 


” X • 
Ep^e  1 


fPjAj^e'^i^  CPj  ejAje'^j^  - ejA^^e'^^k 


-A.t 


rXut 


E[Aj(t)]  = h^(t)  = 


fpi 


e'^i^  + (pj  + e)e'^j^ 


+ Cp,  - Oe'^k^ 


Ep.A.e'^i^  ^ £(A.e'^j^  - Aj^e'k^) 
Ep.e’^i^  + e(e'^j^  - e'^k^) 


Assume  that  E[A^(t)]  < E[A2(t)].  Then  we  have 


Ep.A 


.-A,t 


ie'n*-  + eCA.e'^j^  - Aj^e'^k")  Ep-A-e'^ 

_ A iT  _ \ 4.  ' ^ ^ ' 


■ Ai,t, 


-A,t 


Ep.e'^i^  + eCe'^j^  - e‘^k^) 


Ep.e'^i^ 


Here,  h, (t)  and  h2(t)  are  the  failure  rate  functions  for 
Tj^  and  T2  respectively. 
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Ep.e'^i^[Zp.X.e“H^  + e (X  ^ e'^  ^ - X ] 

< Ep^X^e’^i^[Zp^e~^j^  + e (e'^j^  - e~^k^)  ] 


- Xj^e'H 

S'  - e-V  - "2 


i 


(3.4) 


- (Xj^-Xj)t 


(Xk-Xj)t 


< h2(t) 


Taking  the  limit  as  t -►  <»  in  expression  (3.4),  "*■ 

according  to  Theorem  2.2,  we  have  Xj  £ Xj^.  Therefore,  j = 1 
is  a necessary  condition,  that  is,  for  j ^ 1,  the  assumption 
that  E[Aj^(t)]  £ E[A2(t)]  leads  to  a cpntradiction.  Then, 
hypotheses  HI,  H2  and  H5  are  false, 
b.  Hypothesis  H3 

We  first  state  an  additional  hypothesis: 


H6:  ^E[Ai(t)]  < E[A2(t)],  t > 0.  (E  C B) 


From  section  III.B.4.  we  know  that  F c D c B.  If  H6  is  false, 
then  E n ^ is  not  empty  which  implies  that  E n is  not  empty, 
disproving  H3. 

H6  is  shown  to  be  false  by  taking  k = n and  j 1 
in  the  counter-example  of  section  III. C. 2. a.  Using  the 
definition  (3.1),  it  is  easily  verified  that  A-^  £ *^^^2-  From 
that  counter-example,  however,  we  know  that  j = 1 is  a neces- 
sary condition  for  B.  Therefore,  H6  is  false,  disproving  H3. 


1 

I 

! 

i 
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3.  Proof  of  Hypothesis  H4 

We  can  go  beyond  hypothesis  H4  and  show  an  equivalence 
between  likelihood  ratio  orderings  in  the  initial  and  residual 
mixing  distributions  in 

Proposition  5.1.  t ^ 0. 

Proof : r=^)  From  equation  C2.3)  we  know  that  for  a function 


E{u[A(t)]}  = 


Similarly, 


E [u(A2,Ai)e‘^^1^^2^^] 

Ep{u[Az(t)  ,AiCt)]  } = ^ ^^-(A^+Az)tj 


Choose  a function  (j)  such  that  <})(x,y)  = -(J)(y,x)  and  <J)Cx,y)  ^ 0, 


for  X > y.  Then 


E„[4>(A2,A,)e‘^^1^^2^^] 
Ep(*[A2(t),AiCt)J}  = P ^ ^^(Al.A,■)t^ 


Ep[t|;JA2,Ai)] 


E_[e'  ^^l"’^2^^] 
P 


where  i|;^(x,y)  = ((i  (x,y)  e' ^ . Note  that  ij^^(x,y)  * -4'^(y»x) 
and  (|;^(x,y)  ^ 0 for  x ^ y.  By  hypothesis,  then, 

E [4't(A2»Ai)]  > 0»  and  A^(t) 
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Then 


Ep{(J)  [A2(t)  ,Aj^(t)]  } > 0 
Ep[<DCA2,Ai)e'^^l'‘^2^^] 


Ep[e" 

, Ep[4)(A2,A^)  1 > 0,  and  A^  t^2' 

With  the  proof  of  Proposition  3.1,  then,  we  have 


established  that,  of  the  orderings  considered,  only  likelihood 
ratio  ordering  between  two  initial  mixing  distributions  is 
sufficient  to  guarantee  an  improvement  in  the  mixture  failure 
rate  function  for  any  time  t ^ 0.  This  would  seem  to  be  an 
extremely  strong  requirement;  however,  according  to  Karlin  [23], 
most  of  the  more  common  distributions  belong  to  this  class. 

The  gamma  distribution,  in  particular,  is  a member.  We  can 
show  this  by  noting  for  the  gamma  distribution,  for  u > v. 


gCu]  ^ ^ rii/'\-e(u-v) 

iCv)  ^a-l^-6v  '-v^ 


We  note  that  this  expression  is  increasing  in  a and 
decreasing  in  B.  So,  whether  we  are  changing  a or  6,  holding 
the  other  fixed,  the  result  will  be  two  distributions  which 
are  likelihood  ratio  ordered.  To  see  that  such  an  alteration 
would,  in  fact,  lead  to  an  ordering  of  the  mixture  failure 
rate  function  over  time,  recall  expression  (1*5)  which 


showed 
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4 . Shifting  Mass  from  One  Population  to  Another 

A common  situation  is  one  in  which  an  item  which  fails 
according  to  an  exponential  life  distribution  is  obtained  from 
several  sources  or  populations  having  different  failure  rates. 
The  survival  function  for  the  mixture  then  becomes 

FCt)  = s p.e  ^i^ 
i = l ^ 

for  n populations,  each  having  a failure  rate  and  compris- 
ing a part  of  the  mixture  p^.  An  obvious  way  to  improve  the 
mixture  would  be  to  shift  mass  from  one  population  to  another 
having  a lower  failure  rate.  From  the  counter-example  given 
in  section  III. C, 2. a,  we  know  that  in  order  to  guarantee  an 
improvement  in  the  failure  rate  of  the  mixture  uniformly  over 
time  (that  is,  for  a shift  from  A2  to  A^,  we  want  E[Aj^(t)] 

£ E[A2(t)],  t ^ 0)  the  population  receiving  the  increase  in 
mass  must  be  that  one  having  the  minimum  failure  rate.  That 
is,  shifting  mass  to  the  most  reliable  population  in  the 
mixture  is  a necessary  condition.  Likelihood  ratio  ordering 
among  initial  mixing  distributions  was  shown  in  section 
III.C.3.  to  be  a sufficient  condition  for  such  a uniform 
improvement  in  the  failure  rate. 

Recall  the  statement  of  the  example  of  section 
1 1 1. C. 2. a.  As  noted  above,  we  know  that  j = 1.  Through  a 
procedure  analagous  to  that  in  the  proof  of  Lemma  3.2,  using 

sums  instead  of  integrals,  it  is  easily  seen  that  in  this 
/a. 

case  for  A^  1 ^2  have,  for  i > m. 


40 


PCA^  - A.)  ^ f(A^  = A.) 

HAi  = = V • 

Suppose  k n.  Let  ra  = k and  i = n to  get 

^ _2n_  > £n  ^ ^ 

PCAi  = Pk  ■ ^ Pk  PCAz  = 

and  A^  A2.  Then  k = n and  shifting  mass  from  the  worst 
population  to  the  best  population  is  sufficient  for  an  improve- 
ment in  the  failure  rate  of  the  mixture  uniformly  over  time. 

We  note  here  that  the  intuitively  appealing  approach 
of  simply  shifting  mass  from  a poorer  population  to  a better 
one  will  not  lead  to  a lower  mixture  failure  rate  function 
over  all  time.  Unless  the  shift  is  made  from  the  worst  to 
the  best,  there  will  be  some  time  at  which  the  two  mixture 
failure  rate  functions  will  cross. 

5.  Likelihood  Ratio  Ordering  of  Ti  and  T? 

We  show  a likelihood  ratio  ordering  among  initial  mix- 
ing distributions  to  imply  a likelihood  ratio  ordering  of  the 
opposite  sense  in  the  times  to  failure  of  the  mixture,  and 
T2,  in 

JLa.  Lh. 

Proposition  5.2.  £ A2  ^ T2. 

Proof : Suppose  A^^  £ Define  the  function 

(xy(e-t>''2  * ’'h)  - e'(>'h  * ="2^), 


<^(x,y) 


If  i 


I 

r 


We  note  that  <K.x,y)  = -<J>Cy»x)  and  4>(x,y)  ^ 0 for  x > y ^ 0. 
By  hypothesis,  Ep  [4>CA2,  ^ 0.  Then,  for  tj^  < t2» 


E {Aj^A2[e’ ^^1^2  ^2^1^  - e' ^^2^2^]}  > 


E [A,A,e’^^1^2  ^2^1^]  > E [A.A.e'^^1^1  ^2^2^] 

p lZ  •*—  p'-iZ 


E(Aj^e‘^1^2)E(A2e'''^2^1)  > E(Aj^e‘''^i^l)E(A2e'''^2^2) 


E(A2e'^2^2)  E(Aj^e  '*'i^2) 

T^ITT  - TTTT^xrnr  ’ ^ ^2  ' 


E(A,e  “2'-l)  E(A,e  “l‘'l) 


f2(t2)  ^ fiCt2)  ^ ^ ^ 

^ -■  ^ ^ f ^ ^2 


^2 

IfL 


D 


that  is,  1 ^2' 

6.  Mean  Residual  Lifetime  Ordering 

The  mean  residual  lifetime  at  time  t corresponding 
to  a distribution  F is 


(t) 


U(t)  = 1 F(x)dx  = E(t  - t|T  > t) 

F(t) 


Vl 


For  Tj^  1 ^2,  we  use  equation  C3.3)  to  write 


Fj^Cx)  F2CX) 

< , X > t 


F^Ct)  F2(t) 


1 


I i 

I I 
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